Goto

Collaborating Authors

 machine vision system


A Robotic System for Precision Pollination in Apples: Design, Development and Field Evaluation

Bhattarai, Uddhav, Sapkota, Ranjan, Kshetri, Safal, Mo, Changki, Whiting, Matthew D., Zhang, Qin, Karkee, Manoj

arXiv.org Artificial Intelligence

Global food production depends upon successful pollination, a process that relies on natural and managed pollinators. However, natural pollinators are declining due to different factors, including climate change, habitat loss, and pesticide use. Thus, developing alternative pollination methods is essential for sustainable crop production. This paper introduces a robotic system for precision pollination in apples, which are not self-pollinating and require precise delivery of pollen to the stigmatic surfaces of the flowers. The proposed robotic system consists of a machine vision system to identify target flowers and a mechatronic system with a 6-DOF UR5e robotic manipulator and an electrostatic sprayer. Field trials of this system in 'Honeycrisp' and 'Fuji' apple orchards have shown promising results, with the ability to pollinate flower clusters at an average spray cycle time of 6.5 seconds. The robotic pollination system has achieved encouraging fruit set and quality, comparable to naturally pollinated fruits in terms of color, weight, diameter, firmness, soluble solids, and starch content. However, the results for fruit set and quality varied between different apple cultivars and pollen concentrations. This study demonstrates the potential for a robotic artificial pollination system to be an efficient and sustainable method for commercial apple production. Further research is needed to refine the system and assess its suitability across diverse orchard environments and apple cultivars.


Machine Vision-Based Crop-Load Estimation Using YOLOv8

Ahmed, Dawood, Sapkota, Ranjan, Churuvija, Martin, Karkee, Manoj

arXiv.org Artificial Intelligence

Labor shortages in fruit crop production have prompted the development of mechanized and automated machines as alternatives to labor-intensive orchard operations such as harvesting, pruning, and thinning. Agricultural robots capable of identifying tree canopy parts and estimating geometric and topological parameters, such as branch diameter, length, and angles, can optimize crop yields through automated pruning and thinning platforms. In this study, we proposed a machine vision system to estimate canopy parameters in apple orchards and determine an optimal number of fruit for individual branches, providing a foundation for robotic pruning, flower thinning, and fruitlet thinning to achieve desired yield and quality.Using color and depth information from an RGB-D sensor (Microsoft Azure Kinect DK), a YOLOv8-based instance segmentation technique was developed to identify trunks and branches of apple trees during the dormant season. Principal Component Analysis was applied to estimate branch diameter (used to calculate limb cross-sectional area, or LCSA) and orientation. The estimated branch diameter was utilized to calculate LCSA, which served as an input for crop-load estimation, with larger LCSA values indicating a higher potential fruit-bearing capacity.RMSE for branch diameter estimation was 2.08 mm, and for crop-load estimation, 3.95. Based on commercial apple orchard management practices, the target crop-load (number of fruit) for each segmented branch was estimated with a mean absolute error (MAE) of 2.99 (ground truth crop-load was 6 apples per LCSA). This study demonstrated a promising workflow with high performance in identifying trunks and branches of apple trees in dynamic commercial orchard environments and integrating farm management practices into automated decision-making.


Design, Integration, and Field Evaluation of a Robotic Blossom Thinning System for Tree Fruit Crops

Bhattarai, Uddhav, Zhang, Qin, Karkee, Manoj

arXiv.org Artificial Intelligence

The US apple industry relies heavily on semi-skilled manual labor force for essential field operations such as training, pruning, blossom and green fruit thinning, and harvesting. Blossom thinning is one of the crucial crop load management practices to achieve desired crop load, fruit quality, and return bloom. While several techniques such as chemical, and mechanical thinning are available for large-scale blossom thinning such approaches often yield unpredictable thinning results and may cause damage the canopy, spurs, and leaf tissue. Hence, growers still depend on laborious, labor intensive and expensive manual hand blossom thinning for desired thinning outcomes. This research presents a robotic solution for blossom thinning in apple orchards using a computer vision system with artificial intelligence, a six degrees of freedom robotic manipulator, and an electrically actuated miniature end-effector for robotic blossom thinning. The integrated robotic system was evaluated in a commercial apple orchard which showed promising results for targeted and selective blossom thinning. Two thinning approaches, center and boundary thinning, were investigated to evaluate the system ability to remove varying proportion of flowers from apple flower clusters. During boundary thinning the end effector was actuated around the cluster boundary while center thinning involved end-effector actuation only at the cluster centroid for a fixed duration of 2 seconds. The boundary thinning approach thinned 67.2% of flowers from the targeted clusters with a cycle time of 9.0 seconds per cluster, whereas center thinning approach thinned 59.4% of flowers with a cycle time of 7.2 seconds per cluster. When commercially adopted, the proposed system could help address problems faced by apple growers with current hand, chemical, and mechanical blossom thinning approaches.


Challenges of Artificial Intelligence -- From Machine Learning and Computer Vision to Emotional Intelligence

Pietikäinen, Matti, Silven, Olli

arXiv.org Artificial Intelligence

Artificial intelligence (AI) has become a part of everyday conversation and our lives. It is considered as the new electricity that is revolutionizing the world. AI is heavily invested in both industry and academy. However, there is also a lot of hype in the current AI debate. AI based on so-called deep learning has achieved impressive results in many problems, but its limits are already visible. AI has been under research since the 1940s, and the industry has seen many ups and downs due to over-expectations and related disappointments that have followed. The purpose of this book is to give a realistic picture of AI, its history, its potential and limitations. We believe that AI is a helper, not a ruler of humans. We begin by describing what AI is and how it has evolved over the decades. After fundamentals, we explain the importance of massive data for the current mainstream of artificial intelligence. The most common representations for AI, methods, and machine learning are covered. In addition, the main application areas are introduced. Computer vision has been central to the development of AI. The book provides a general introduction to computer vision, and includes an exposure to the results and applications of our own research. Emotions are central to human intelligence, but little use has been made in AI. We present the basics of emotional intelligence and our own research on the topic. We discuss super-intelligence that transcends human understanding, explaining why such achievement seems impossible on the basis of present knowledge,and how AI could be improved. Finally, a summary is made of the current state of AI and what to do in the future. In the appendix, we look at the development of AI education, especially from the perspective of contents at our own university.


TTCI R&D: Machine Learning for Machine Vision Systems - Railway Age

#artificialintelligence

RAILWAY AGE, JULY 2021 ISSUE: Reliable, real-time monitoring of in-service railcar components will enhance the potential for maintenance planning. Through the Association of American Railroads (AAR) Strategic Research Initiatives (SRI) program, Transportation Technology Center, Inc. (TTCI) has been assisting suppliers and other stakeholders in the development of machine vision technologies and related algorithms for evaluating railcar components and conditions. To enhance safety and reduce worker exposure to yard risk, North American railroads have begun to install machine vision inspection systems in revenue service. Using commercially available deep learning system platforms, TTCI researchers developed and demonstrated three convolutional neural network-based applications for analyzing visual images. A convolutional neural network is a type of artificial neural network that uses machine learning algorithms to analyze digital images. Convolutional neural networks are more powerful and effective than traditional artificial neural networks at recognizing, interpreting, and categorizing large, unstructured data sets; particularly those comprised of visual imagery.


Everything you need to know about Visual Inspection with AI

#artificialintelligence

Artificial Intelligence is turning out to be a game changer, with countless applications in nearly every domain. It is now making its way into the area of Production and Manufacturing, allowing it to harness the power of deep learning and in doing so, providing automation that is faster, cheaper and more superior. This article aims to give a brief understanding of automated visual assessment and how a deep learning approach can save significant time and effort. It involves the analysis of products on the production line for the purpose of quality control. Visual inspection can also be used for internal and external assessment of the various equipment in a production facility such as storage tanks, pressure vessels, piping, and other equipment.


Maximize existing QA vision systems with Deep Learning AI - Mariner

#artificialintelligence

The reputation and bottom line of a company can be adversely affected if defective products are released. If a defect is not detected, and the flawed product is not removed early in the production process, the damage can be costly – and the higher the unit value, the higher those costs will be. And worst of all, dissatisfied customers can demand returns. To mitigate these costs, many manufacturers install cameras to monitor their products as they move along their production lines. However, the data obtained may not always be useful – or more appropriately said, the data is useful, but existing machine vision systems may not be able to accurately assess it at full production speeds.


Thwarting adversarial AI with context awareness -- GCN

#artificialintelligence

Researchers at the University of California at Riverside are working to teach computer vision systems what objects typically exist in close proximity to one another so that if one is altered, the system can flag it, potentially thwarting malicious interference with artificial intelligence systems. The yearlong project, supported by a nearly $1 million grant from the Defense Advanced Research Projects Agency, aims to understand how hackers target machine-vision systems with adversarial AI attacks. Led by Amit Roy-Chowdhury, an electrical and computer engineering professor at the school's Marlan and Rosemary Bourns College of Engineering, the project is part of the Machine Vision Disruption program within DARPA's AI Explorations program. Adversarial AI attacks – which attempt to fool machine learning models by supplying deceptive input -- are gaining attention. "Adversarial attacks can destabilize AI technologies, rendering them less safe, predictable, or reliable," Carnegie Mellon University Professor David Danks wrote in IEEE's Spectrum in February.


Council Post: From Computer Vision To Deep Learning: How AI Is Augmenting Manufacturing

#artificialintelligence

In the race to enable manufacturing plants to increase production in the face of an intermittent human workforce, manufacturers are looking at how to supplement their cameras with AI to give human inspectors the ability to spot defective products immediately and correct the problem. While machine vision has been around for more than 60 years, the recent surge in the popularity of deep learning has elevated this sometimes misunderstood technology to the attention of major manufacturers globally. As CEO of a deep learning software company, I've seen how deep learning is a natural next step from machine vision, and has the potential to drive innovation for manufacturers. How does deep learning differ from machine vision, and how can manufacturers leverage this natural evolution of camera technology to cope with real-world demands? In the 1960s, several groups of scientists, many of them in the Boston area, set forth to solve "the machine vision problem."


Global Big Data Conference

#artificialintelligence

In the race to enable manufacturing plants to increase production in the face of an intermittent human workforce, manufacturers are looking at how to supplement their cameras with AI to give human inspectors the ability to spot defective products immediately and correct the problem. While machine vision has been around for more than 60 years, the recent surge in the popularity of deep learning has elevated this sometimes misunderstood technology to the attention of major manufacturers globally. As CEO of a deep learning software company, I've seen how deep learning is a natural next step from machine vision, and has the potential to drive innovation for manufacturers. How does deep learning differ from machine vision, and how can manufacturers leverage this natural evolution of camera technology to cope with real-world demands? In the 1960s, several groups of scientists, many of them in the Boston area, set forth to solve "the machine vision problem."